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Abstract 

Starting from the model of continuous time random walk (Montroll 
and Weiss 1965) that can also be considered as a compound renewal pro- 
cess we focus our interest on random walks in which the probability dis- 
tributions of the waiting times and jumps have fat tails characterized by 
power laws with exponent between and 1 for the waiting times, between 
and 2 for the jumps. By stating the relevant lemmata (of Tauber type) 
for the distribution functions we need not distinguish between continuous 
and discrete space and time. We will see that by a well-scaled passage 
to the diffusion limit diffusion processes fractional in time as well as in 
space are obtained. The corresponding equation of evolution is a linear 
partial pseudo-differential equation with fractional derivatives in time and 
in space, the orders being equal to the above exponents. Such processes 
are enjoying increasing popularity in applications in physics, chemistry, 
finance and other fields, and their behaviour can be well approximated 
and visualized by simulation via various types of random walks. For their 
explicit solutions there are available integral representations that allow to 
investigate their detailed structure. For ease of presentation we restrict 
attention to the spatially one-dimensional symmetric situation. 
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1 Introduction: concepts and notations 



We consider spatially one-dimensional random walks of the following basic struc- 
ture. A particle (or a wanderer) starting at the time instant t = at the 
space point x — makes jumps of random size Xk in random instants tk, 
k £ N = {1, 2, 3, • • • }, < ti < t2 ■ ■ ■ — > oo. For convenience we set to = 0. 
Then in the time interval t n < t < t n+ i the particle is sitting in the point 

n 

x = S n := ^2 We assume the jumps to be independent identically dis- 
k=l 

tributed (iid) random variables, all having the same probability distribution as 
a generic real random variable X , called the jump. Likewise we assume the 
waiting times T\. := th — ifc— i to be iid random variables, all equal in distribution 
to a generic non-negative random variable T , called the waiting time. So, this 
process is what in mathematical literature is called a compound (or cumulative) 
renewal process [5] . We denote the distribution functions of the waiting time T 
and the jump X by $ and W, respectively, by 

P(T <t) = $(t) , < t < oo ; P(X <x) = W(x) , -oo < x < oo . 

Conveniently using the language of generalized functions in the sense of [8] or 
|30j we introduce the (generalized) probability densities 4> and w, so that 



®(t) = J 4>(t )di , < t < oo ; W(x) = J w{x')dx' , -oo < x < oo . 

-oo 

Denoting for time instant t the probability density to find the particle in point 
x by p(x, t) we then have, by conditioning on the last jump before t and using 
the delta function S(x), for < t < oo and — oo < x < oo the integral equation 
(see [24]) of continuous time random walk 

t oo 

o . <W( i - •«» + /( / „■(* - ^,0*0 «< - 0*' • (1.D 

-oo 

X 

For the cumulative function P(x, t) = J p{x f , da;' we have, with the Heaviside 

— oo 

step function H(x) 1 the equation 

t oo 

P(x,t) = H(x)(l - $(*)) + W(x-rs , )dP(x , ,0}d*(<-*')- ( L2 ) 

-oo 

To proceed further we use the machinery of the transforms of Laplace and 
Fourier. The general formulas for s>0, — oo < k < oo are 

oo oo oo oo 

g(s) = J er st g(t)dt = J e - st dG(t) ; /(k) = J e lKX f{x)dx = J e lKX dF(x) . 

— OO — OO 
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Essentially applying these formulas to probability densities with < t < oo and 
— oo < x < oo we can safely take the Laplace variable s as real and non-negative. 
Furthermore we will work with convolutions of (generalized) functions, namely 
with the Laplace convolution and the Fourier convolution: 



(3i * 92)(t) = / gx(t')gi{t - t')dt' ; {fx * f 2 ){x) = / h{x')h{x - x')dx' 



Then, applying the transforms of Fourier and Laplace in succession to the equa- 
tion (jl.ip and using the well-known operational rules, we arrive at the relation 

p{K, s) = + (/)(s)w(k)p(k, s) , (1.3) 

s 

which leads to the famous Montroll- Weiss equation, see [24], 

P {k,s) = p-i- - . (1.4) 

S 1 — W{K)<p(S) 

This equation can alternatively be derived from the Cox formula, see [5] chapter 
8 formula (4), describing the process as subordination of a random walk to a 
renewal process. By inverting the transforms one can, in principle, find the 
evolution p{x, t) of the sojourn density for time t running from zero to infinity. 

Our aim is to show that under appropriate assumptions of power laws for the 
distribution functions <&(£), t > 0, and W{x), — oo < x < oo, under observance 
of a scaling relation between the positive parameters h and r the re-scaled 

n n 

random walk S n {h) = hXk happening at the instants t„(r) = rTk (with 

fc=l k=l 

So{h) = 0, to{r) = ) weakly (or in law) tends, for h and r tending to zero, 
to a process obeying the space-time fractional diffusion equation. Specifically, 
we will show that the sojourn probability density p/ ljT (x, t) tends weakly to the 
solution u{x, t) of the Cauchy problem for t > and i£l 



D 13 u{x, t) = R a u{x, t) , u{x, 0) = 5{x) . (1.5) 



Here 0<a<2, Q < /3 < 1. The fractional Riesz derivative R a (in space) is 
defined as follows: the Fourier transform oiR a f{x) is — |k| q /(k) for a sufficiently 
well-behaved function f{x). Compare [6], [25], [26]. The Caputo fractional 
derivative (in time) can be defined through its image in the Laplace transform 

domain. The Laplace transform of g(t) is s^gfs) — s^^O). We have 

t * 

D P g{t) = for/3= 1 but 



Pf 9{t) = T\T^W) { Jt j {t ~ t'^^'W - r ^(0)l for < /3 < 1 , 
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compare [TU] . In the Fourier-Laplace domain the Cauchy problem (|1.5I) appears 
in the form s^u(k, s) — s 13 ^ 1 = — |k| q u(k, s) from which we obtain 

u(k, s) = —a ; — i— , s > , cel. (1-6) 

y ; si 3 + |k| q y j 

Let us refer to [TB] for the analytical theory of representing the function 
u(x,t) , namely the fundamental solution of the space-time fractional diffusion 
equation, in dependence on the parameters a and (3. 

To carry out the passage to the diffusion limit we state in Section 2 two MAS- 
TER LEMMATA and four simplifications relating the asymptotic behaviours of 
the distribution functions W(x) and <&(t) near infinity to the asymptotic be- 
haviour of their Laplace and Fourier transforms near zero. Section 3 is devoted 
to the actual passage to the diffusion limit, in Section 4 some examples are 
presented, and a few historical comments are given in Section 5. 



2 Six lemmata 

Definition: As in [3] we call a positive measurable function v, defined on some 
neighbourhood [x*, oo) of infinity , slowly varying if v(ax) / v(x) — > 1 as x — > oo 
for every a > 0. Examples: (logx) 1 with 7 e M and exp ( u^giogx ) • 

MASTER LEMMA 1: Assume W(x) increasing, W(-oo) = 0, VF(oo) = 1, 
symmetry J dW(x') = J dW(x') for x > 0, let L be a slowly varying 

( — 00, — a;) (a;, oo) 

function and assume either (a) or (b). 

00 

(a) er 2 := J x 2 dW(x) < 00, labelled as a = 2 , 

—00 

(b) / dW(x) - fea- 1 :^^^) for x -> 00, a G (0, 2) and 6 > 0. 

(x,C3o) 

Then, with 

A* = TT and L ( x ) = 1 in case ( a ): A* = ^ — ; 773: in case (b) , (2.1) 

2 1 (a + l)sin{an/2) 

we have the asymptotics 1 — w(k) ~ /i|K| a L(|K| _1 ) for k — > 0. 

Comments The proof can be distilled from Chapter 8 of [3]. In some sense 
this lemma is a partial reformulation (with a constant corrected) of Gnedenko's 
theorem on the domain of attraction of stable probability laws, see [9]. 

MASTER LEMMA 2: Assume $(t) increasing, $(0) = 0, $(00) = 1, let 

M be a slowly varying function and assume either (A) or (B). 

00 

(A) p := J td$(t) < 00, labelled as (3 = 1, 



(B) J d$(t) - c{3-H-Hl(t) for A — > 00, /3 € (0, 1) and c> 0. 

(i,oo) 



4 



Then, with 

X = p and M(t) = 1 in case (A), A = CT ^~ ^ in case (B) , (2.2) 

P 

we have the asymptotics 1 — <f>(s) ~ As' 3 Af(s~ 1 ) for < s — > 0. 

Comments This lemma is a special case of Karamata's theorem of 1931. A 
proof can be found in the book [3] . In the case of existing non-generalized func- 
tions as densities the Master Lemmata imply the two following (convenient) 
C-Lemmata (by integration it can be shown that the assumptions of the Master 
Lemmata are met). See [12] ■ For the fully equidistant discrete case the two 
D-Lemmata are useful. See [15] . 

C-Lemma 1 (for jump densities): Assume w(x) > 0, w(x) = w(—x) for ieR, 

oo 

J w(x)dx — 1 and either (a) or (b). 

— oo 

oo 

(a) er 2 := J x 2 w(x)dx < oo, labelled as a = 2, 

— oo 

(b) w(x) ~ 6|x|-( Q+1 ) for \x\ -> oo, a € (0,2) and b > 0. 
Then with p as in (|2.1[) . we have the asymptotics 

1 - w(k) ~ m|k| q for k -> . (2.3) 

oo 

C-Lemma 2 (for waiting time densities): Assume <f>(t) > for t > 0, J <p(t)dt — 

o 

1, and either (A) or (B). 

oo 

(A) p := J t(f>(t)dt < oo, labelled as = 1, 

o 

(B) <f>{t) ~ ct~^ +1 ^ for i oo, /3 e (0, 1) and c> 0. 
Then with A as in (|2.2p . we have the asymptotics 

1 - £(«) - As^ . (2.4) 



D-Lemma 1: Assume p/c > 0, ^ Pfe — lj symmetry pk = P—k for all integers 

— oo 

k G Z, and either (a) or (b). 

oo 

(a) cr 2 := ^ ^ 2 Pfe < oo, labelled as a = 2, 

— oo 

(b) p k ~ b|fc|-( a+1 > for |fc| -> oo, a e (0, 2) and 6 > 0. 
Then with /i as in (|2.ip we have the asymptotics 



D-Lemma 2: Assume c„ > 0, c„ = 1 and either (A) or (B). 

oo 

(A) p := X] nc « < °°! labelled as /3 = 1, 

i 

(B) c„ - cn-^ +1 ) for n -> oo, (3 G (0, 1) and c> 0. 
Then with A as in (|2.2p we have the asymptotics (|2.4p . 
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3 Well-scaled passage to the diffusion limit 



As already indicated in the Introduction, we multiply the jumps Xk by a factor 
h, the waiting times 71- by a factor r. So, we get a transformed random walk 

n n 

Sn(h) = with jump instants t n (r) — T Tk that we now investigate 

fc=i fe=i 
with the aim of passing to the limit h — > 0, r — > under a scaling relation 

between h and r yet to be established, assuming that the conditions of Master 

Lemma 1 and Master Lemma 2 are fulfilled. As it is convenient to work in the 

Fourier-Laplace domain we note that the density <fi T (t) of the reduced waiting 

times tT)~ and the density Wh (x) of the reduced jumps hXk are0 T (i) = (f>(t/r)/T, 

t > ; Wh{x) — w{x/h)/h, — oo < x < oo. The corresponding transforms 

are simply <f> T (s) — </>(st), = w(kK). We are interested in the sojourn 

probability density ph tT (x, t) of the particle subject to the transformed random 

walk. In analogy to the Montroll- Weiss equation (|1.4[) we get 

fU*.) = l -~ M8) J~ = 1 ^ {TS) - 1 ~ • (3-D 
s 1 — Wh(K)<f> T (s) s 1 — w(hk)4>(sr) 

Considering now s and k fixed and ^ we find for h — > 0, r — > from the 
Master Lemmata (replacing there k by k/i, s by st ) by a trivial calculation, 
omitting asymptotically negligible terms and using the slow variation property 
L(l/(nh)) - L(l/h), M(l/(sr)) - M(l/r), the asymptotics (JOJ) with ((33)) . 

Ph ' T ^ 7 S > ~ fj,(h\K\) a L(l/h) + X(TsfM(l/T) ~ r(h, T)\n\ a + si 3 ' ( ' ' 
So we see that for every fixed real k^O and positive s 

Ph,r( K ' S ^ ^ I |a I g = M(«)«) » (3-4) 

as h and r tend to zero under the scaling relation r(h, r) = 1. Comparing with 
(II. 6|) we recognize here u(k, s) as the combined Fourier-Laplace transform of the 
solution to the Cauchy problem (11. 5|) . Invoking now the continuity theorems 
of probability theory (compare [7]) we see that the time-parameterized sojourn 
probability density converges weakly (or in law) to the solution of the Cauchy 
problem (|1.5[) . We state this result at the following theorem. 

Theorem: Assume the probability laws for the jumps Xi~ and the waiting 
times Tfc to fulfill the conditions of the Master Lemmata 1 and 2, respectively. 
Replace the jumps by hXk, the waiting times tT^. Then for h (and consequently 
r) tending to zero the solution p/j iT (x, t) of the rescaled integral equation (jl.ip 
(the densities there to be decorated with indices h and r) converges weakly to 
the solution of the Cauchy problem (j 1 . 5|) . in other words: to the fundamental 



solution of the space-time fractional diffusion equation D p u(x, t) = R a u(x, t). 

t * 
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4 Examples of random walks 



Let us first consider the space-time fractional diffusion equation more closely 
with regard to special choices of the parameters a and j3. In the very particular 
case a = 2, p = 1 it reduces to the classical diffusion equation ^| = In 
the case a — 2, < f3 < 1 we have the time-fractional diffusion equation inves- 
tigated in 1989 28J. In the case < a < 2, (3 — 1 we have the space-fractional 
diffusion equation for which the fundamental solution is a symmetric strictly sta- 
ble probability density evolving in time. Whereas the time-fractional case a = 2, 
< < 1 exhibits subdiffusive behaviour, we have superdiffusive behaviour, if 
< a < 2. All this can be deduced from the Fourier-Laplace representation 



(|I.6|) by observing that the variance {(x(t)) 2 ) = (a(t)) 2 = J x 2 u(x,t)dx of 

— oo 

the position x(t) of a diffusing particle is given as —-^2u(n,t)\ K=0 . Using the 

oo 

Mittag-LefHer function Ep(z) = r(i+n/3) ( see E3) we nn< ^ by Laplace inver- 

n— 

sion the convergent series u(n 7 t) = Ep{— |k| q ^) = I 



\ K \"t P \K\ 2a i^ 

r(i+/3) + r(i+2/3) 



from which for t > we get {cr(t)) 2 = yw+W) ir « = 2 , (c(i)) 2 = oo if < a < 2. 



t* 3 
r ( 1+ ' 9 ) 

Now we present two concrete random walk models, for both assuming < 
a < 2, < (3 < 1. The first example is in continuous time and continuous 
space. From [4] we got the idea that it is advantageous to work with functions 
W(x) and $(£) that can elementary be inverted. This is useful to produce from 
[0, 1)-uniformly distributed pseudo-random numbers the jumps and the waiting 
times in simulations. We take, compare [IT] and [20] . 

W(x) = - + l(-i)"9"(g) !ql , $(t) = 1 1 

w 2 2^ ; f + x a ' w 1 



r(i - p)tP ' 

Then we have case (b) of MASTER LEMMA I with b = a/2 and L(x) = I, and 
case (B) of MASTER LEMMA 2 with c = l/\T(-j3)\, M(t) = I. 

In the second example time and space are equidistantly discretized. We take 
po = 0, p k = 6|fc|-( Q+1 ) for ^ k e Z, c„ = cn~(' 3+1 ) for n e N, and set 

oo oo 

w(x) = PkS{x — k), 4>(t) — c k5{t — k) (compare with I5j). We have case 

— oo k=l 

(b) of D-Lcmma I, case (B) of D-Lemma 2 and identify readily (with C,(z) de- 
noting Riemann's zeta function) b = 2 ^(a+i) anc ^ c = C(ff+i) ' sequences 
pi , p2 , P3, ■ ■ ■ and ci , C2 , C3 , • • • have the nice property of being completely mono- 
tone. The excluded border cases a — 2 and (3 = 1 are singular. 

To convey to the reader a feeling for fractional diffusion we present a few 
graphical results of approximating random walks, simulated according to the 
first example. They show in sequence the case of Brownian motion (classi- 
cal diffusion), time-fractional diffusion, space- fractional diffusion, space-time- 
fractional diffusion. 

Note that for a — 2, we use the jump density w(x) = exp(— ^-), for 
(3 = 1 the waiting time density 4>(t) = exp(-t). For < a < 2 and < (3 < 1 
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we take the jump distribution W(x) and the waiting time distribution $>(t), 
both as in the first example. 

Observe some long waiting times in the case < (3 < 1 and some long jumps 
in the case < a < 2. 
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5 Comments, suggestions and conclusions 



The theory of compound renewal processes, also called renewal processes with 
reward, in physics and other natural sciences called continuous time random 
walks (though space and time need not be continuous) began to flourish in 
the middle of the sixties of the past century, let us quote [23] and [5]. We 
cannot give here a comprehensive survey of relevant literature, so we ask all not 
mentioned contributors to forgive us this surely biased account. For larger lists 
of references and more competent appreciation of achievements and applications 
we recommend [5] and |23j . As an early pioneer Balakrishnan [T| deserves to 
be put into light. He has, in 1985, found the time-fractional diffusion equation 
(a = 2 , < (3 < 1) as the properly scaled diffusion limit for some random 
walks with power law waiting time. At that time, four years before in [28j 
the basic analytic theory was developed, the name fractional diffusion was not 
yet common, and so was not used in [I], hence Balakrishnan did not find the 
resonance he would have deserved. A decisive step forward occurred in [17] in 
1995. Hilfer and Anton, roughly speaking, showed among other things that by 
taking the Mittag-Leffler waiting time density —-f^Ep^—t 13 ) the basic equation of 
continuous time random walk can be transformed to a time-fractional evolution 
equation for the sojourn probability density. Thus they have essentially found 
the time-fractional generalization of the Kolmogorov-Feller evolution equation 
for the compound Poisson process which e.g. is treated in [7]. However, already 
in [T] appears the waiting time density whose Laplace transform is (1 + s' 3 ) -1 
as playing a distinct role, but was not recognized as a function of Mittag-Leffler 
type (such functions too long having been insufficiently known). Gorenflo and 
Mainardi and co-authors have, beginning in 1998, published several papers on 
various types of approximating random walks for space-fractional and space- 
time fractional diffusion processes of which we quote [IT], [J_2], [T3] and [T5] . 
furthermore some papers (stressing the relevance of the Mittag-Leffler waiting 
time) motivated by applications to finance: [27], [20], [14]. In [14] the space- 
time fractional diffusion equation is obtained as a diffusion limit of the time- 
fractionalized Kolmogorov-Feller equation 

oo 

D p(x,i) = -p(x,i) + J w(x - x')p(x',t)dx' . (5.1) 

— oo 

The publications [18] and [19] are devoted to analytic treatment via integral 
representations of the evolving probability densities that solve the (spatially one- 
dimensional) space-time fractional diffusion equation. An important concept in 
fractional diffusion processes is the concept of subordination (see, e.g. [22j and 
[2"T]L By our way of relating the scaling parameters in the passage to the 
limit we circumvent this concept. Let us mention again 12J. There we have 
based our scaled transition to the limit on two lemmata for the asymptotics 
of the transforms of the densities whereas here we work with the MASTER 
LEMMATA for the distribution functions, motivated by [9]. This, of course, is 
more general and allows discrete and continuous probabilities and mixtures of 
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them. However, in not so general situations the other lemmata may be simpler 
to apply (as we have done in [15] for the fully discrete case with regular grids). 
In [55], in contrast to our treatment in [TJ] and here, the scaling is not done 
via the individual steps in space and time but directly in the distributions of 
waiting times and jumps. However, this is equivalent to our way. Let us in this 
context say a few words to the essential statement of [16]. There Hilfer shows 
that a power law for the waiting time is not sufficient for getting in the limit a 
fractional diffusion process with the fractional time derivative having the same 
order as the power law. This seemingly negative result, however, does not hit 
the theory expanded here in our paper. In Hilfer's counter-example the passage 
to the diffusion limit is not well-scaled in our sense; in fact, in it are hidden two 
different scalings. Thus [16] may inspire to investigate systematically continuous 
time random walks that can be scaled in more than one way. 

Let us, as a final statement, say that the case of non-symmetric jump dis- 
tributions (bypassed in our paper) can analogously be studied, and let us also 
hint to [2T] ■ 
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